System for controlling vehicle information user interfaces

ABSTRACT

A system for controlling a vehicle information system user interface with at least one sensor for sensing the presence of a passenger and a controller for controlling a vehicle information system user interface based upon an output signal from the sensor.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention generally relates to a vehicle, and moreparticularly to a vehicle including a system for detecting the presenceof animate objects (e.g., passengers, pets, etc.) and for controllingthe information system user interface in an appropriate manner.

2. Description of the Related Art

Computer technology for providing information and application functionsto automotive vehicles is becoming pervasive. For example, vehicles arebeing outfitted with computers that contain display devices, speechsynthesis, text-to-speech (TTS) interfaces, and a multitude of inputdevices such as speech recognition, remote control devices, keyboards,track balls, joysticks, touch-screens, etc.

These computerized devices are useful for controlling a vehicle or forthe entertainment of the vehicle occupants (e.g., see U.S. patentapplication Ser. No. 09/311,277 entitled “Information System for MobileUsers”, filed on May 14, 1999, and U.S. patent application Ser. No.09/357,840, entitled “System and Method for Network Vehicle Diagnosticsand Health Monitoring” filed on Jul. 20, 1999, both incorporated hereinby reference).

While the above described equipment is widespread, there has been littlerecognition of the cognitive burden placed on a driver by these devices,particularly those which do not contribute to a driver's primaryresponsibility of controlling a vehicle in a safe and responsive manner.

A driver's senses may be fully occupied as a result of the largecognitive load demanded for driving a vehicle safely. To operate avehicle safely, drivers use their hands for steering and manipulatingother vehicle user interfaces such as the gear shift, turn signals,windshield wipers, heating mechanism, and parking brake. The driver alsomust focus attention on the road, on the traffic, and on vehicleoperation devices such as rear-view mirrors, speedometer, gas gauge, andtachometer.

Distracting or complex output presented to the driver or requirementsfor complicated user input may result in accidents. These must befiltered or controlled while the driver is operating the vehicle. As aresult, in-vehicle devices providing information unrelated to driving avehicle should be easy to operate and not distracting.

Conversely, the same demands for attention are not placed on passengers.Therefore, a device which would be too complicated and distracting for adriver may not be rich enough information-wise for passengers who areable to focus more of their attention on a device not used to controlthe vehicle. Passengers are free to use computational apparatus andinformation delivery systems.

With the conventional systems, a problem has been the lack of tailoringof vehicle information system functions, input and output devices, andthe user interface based upon composition of the passenger group.

The problem of identifying the presence of passengers in a motor vehicleand the importance of controlling vehicle safety systems has beenrecognized previously. Identifying passengers in a vehicle isaccomplished using a variety of means. For example, force sensors,ultrasonic detectors, capacitance detectors, optical detectors, andsound detectors have been used. Passengers are detected in order toenable or advise the use of safety devices such as seat belts or airbags.

Further, the problem of adapting user interfaces has also beenrecognized previously. For instance, an example is found in U.S. Pat.No. 5,648,755 entitled “Display System” and incorporated herein byreference, which teaches the tailoring of the visual display foroperating instruments as a function of the driving conditions of thevehicle.

However, none of the conventional systems teaches modifying aninformation system user interface based upon the presence or absence ofpassengers. Neither does any system even address the presence ofdetecting non-human passengers (e.g., pets, animal cargo, etc.) in avehicle and the effect of in-vehicle devices on such non-humanpassengers.

SUMMARY OF THE INVENTION

In view of the foregoing and other problems, disadvantages, anddrawbacks of the conventional methods and structures, the presentinvention has been devised.

An object of the present invention is to provide a structure fordetecting the presence of passengers and for selectively controlling theinformation system user interface appropriately.

It is another object of the invention to detect when a non-drivingpassenger is using a device (e.g., providing information orentertainment) and selectively enabling the device function to becomplex and more detailed for the passenger.

Additionally, it is an object of the invention to control a device usedby a passenger in a manner conducive to driving safety.

In a first aspect of the invention, a system for controlling a vehicleinformation system user interface includes at least one sensor forsensing the presence of a non-driving passenger in a vehicle, and acontroller for controlling the vehicle information system user interfacebased upon an output signal from the at least one sensor.

Thus, with the invention, a vehicle's information system user interfacemay be selectively changed depending upon whether passengers aredetected in the vehicle. Further, certain distinguishing characteristicsof the passengers are detected enabling additional selective change ofthe vehicle user interface.

BRIEF DESCRIPTION OF THE DRAWINGS

The foregoing and other objects, aspects and advantages will be betterunderstood from the following detailed description of a preferredembodiment of the invention with reference to the drawings, in which:

FIG. 1 is a schematic diagram of a vehicle including a seated personaccording to a preferred embodiment of the present invention;

FIG. 2 is a schematic diagram of a vehicle including a seated pet and adevice for detecting the presence of passengers according to a preferredembodiment of a system of the present invention;

FIG. 3 is a system diagram of components according to the presentinvention.

FIG. 4 depicts audio and video outputs in a vehicle with only a driveraccording to the present invention; and

FIG. 5 depicts audio and video outputs in a vehicle with a driver andpassengers according to the present invention.

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS OF THE INVENTION

Referring now to the drawings, and more particularly to FIGS. 1-5, thereis shown a preferred embodiment of the present invention.

Referring to FIG. 1, a vehicle system 100 is shown for use with avehicle 110 and includes a passenger 200 (e.g., a person) seated withina vehicle 110 having at least one sensor (e.g., sensor circuit) and morepreferably a plurality of sensors located at different positions in thevehicle 120, 130, an electronic control unit (ECU) 140 (and morepreferably a plurality of ECUs) for controlling sensor circuits, avehicle communication bus 105 for carrying data and control signals tothe ECU 140, an ECU 160 interfaced with the bus 105, and at least oneinterface device (and more preferably a plurality of interface devices)including, for example, any one or more of a visual display 170, anaudio system 180.

Further, additional devices 190 may be provided. Such additional devicesmay include a visual display device, an audio system, a keyboard, atelecommunications device, a fax machine, a touch screen, a speechsynthesis system, a voice recognition interface, a wireless remotecontrol device, a scent dispenser, a heating device, and a coolingdevice.

Further, a manually-controlled input device 135 may be provided forinputting parameters to the ECU devices including the indication of thepresence of one or more passengers and for overriding automaticselections if necessary.

FIG. 2 shows the same vehicle system 100 for use in a vehicle 110,including a passenger 205 (e.g., in this case a pet or animal cargo),and the other preferred features of the present invention as abovedescribed in FIG. 1.

Referring to FIG. 3, a block diagram of the system according to thepreferred embodiment is shown and described below.

The system 100 includes a sensor 120 and a sensor 130 for detecting apassenger (e.g., 200, 205 shown in FIGS. 1-2) located inside of thevehicle 110. The sensors can be formed of known and commerciallyavailable components. Many types of sensors may be employed includingany one or more of infrared sensors, capacitive sensors, force/pressuresensors, etc., and are well-known in the art. Such sensor components andconfigurations are described in, for example, U.S. Pat. No. 4,300,116,U.S. Pat. No. 5,402,075, U.S. Pat. No. 5,313,189, U.S. Pat. No.5,629,488, U.S. Pat. No. 5,871,063, U.S. Pat. No. 5,297,430, U.S. Pat.No. 5,305,644, U.S. Pat. No. 5,857,536, U.S. Pat. No. 5,654,615, U.S.Pat. No. Reissue 034,773, and U.S. Pat. No. 5,602,526, each incorporatedherein by reference. U.S. Pat. No. 5,404,128 incorporated herein byreference describes the detection of a passenger based upon the lifeactivity of the human body including heart beat. Such a system using thedistinguishing characteristics of heart beat (e.g. rate, shape, etc.)may be used to distinguish humans from non-humans.

The presence of a passenger causes a change in the electricalcharacteristics of the sensor 120. An additional passenger may changethe electrical characteristics of the sensor 130. Additional sensors maybe used to detect additional passengers.

The sensor's electrical characteristics are monitored by ECU 140, whichresponds to a change by reporting a detection code over the car bus,such as a Society of Automotive Engineers (SAE) J1850 communication bus,or a Controller Area Network (CAN).

The car bus 105 in turn provides the code to a second ECU 160 whichcontrols an interface 170, 180. The ECUs 160, 161, and additional ECUs162, as necessary, may be provided as components within an embeddedelectronic or computing system 150 within the vehicle. The structure ofthe user interface is believed to be well-known to one of ordinary skillin the art taking the present invention as a whole. For example, thestructure of some exemplary user interfaces are described in U.S. Pat.No. 5,648,755, U.S. Pat. No. 5,847,704, U.S. Pat. No. 5,289,184, U.S.Pat. No. 5,635,924, U.S. Pat. No. 5,821,935, U.S. Pat. No. 5,555,172,and U.S. Pat. No. 5,875,108, each incorporated herein by reference.

The interface may control visual and/or audio systems 170, 180, andadditional user interface systems 190.

Also, for example, the modality of input or output may be varied. If nopassenger is detected in the vehicle, voice recognition may be the onlyinput modality used (e.g., enabled by the inventive system). Videodisplay may be turned off and audio may be provided as the only outputmodality. Navigation instructions may be provided to the driver by theuse of translation of computer output to audio using speech synthesis(text-to-speech or TTS) or the playing of digital recordings of humanspeech (one such format is the .wav file).

If a passenger is detected as being present in the vehicle (e.g., assensed by the sensor circuits), the passenger is enabled to use anygraphical user interface (and associated application program(s)) such astouch screens, mouse, keyboard, electronic remote control, joystick,track point, and so forth.

Additionally, the mode or modality for presenting output information maybe varied.

For example, if there is a single display screen for displayinginformation (e.g., the text of incoming e-mail, updated trafficconditions, driving navigation directions, etc.), then the display couldbe turned off, e.g., automatically by the embedded electronic orcomputing system 150, or simply not enabled for a solo driver andinformation provided only through the auditory modality (e.g.,text-to-speech, recorded sound, etc.).

Various input or output devices may be enabled (or disabled) by thedetection by the sensor circuit(s) of a passenger in a seat. Visualdisplays such as a TV monitor or a computer display screen may beenabled or have enriched display content for the use of the passengers.For example, microphones, view screens, user input devices such askeyboards, trackballs, joysticks, mice, etc. could be enabled for usedby passengers detected by the sensor circuit(s) 120, 130.

The physical orientation of input and output devices also may bechanged.

For example, display monitors may rotate to face passengers (rather thana driver) or an empty seat. Another option is to employ shades (e.g.,louvers) or some obscuring technique (e.g., blinds and the like) whichare automatically activated upon starting the vehicle and detecting thatno passengers are present. The louvers allow the passenger(s) to viewenriched video content but obscure the driver's view. Along these lines,such devices could be blocked from activation unless a signal isreceived by the sensor circuits indicating the presence of a passenger.

Moreover, the acoustic characteristics of the vehicle may be changedwith the detected presence of passengers. Audio inputs and outputs maybe adjusted. The speaker balance of sound systems may be shifted. Audiomay be enriched with more details and voice recognition may have aricher voice command set when no passenger is detected. For example, aspeech recognition model could be modified and frequency distribution ofaudio output tuned. A further example is if pets (e.g., dogs, cats etc.as shown in FIG. 2) are detected and audio output levels adjusted so asto not frighten the animal passengers. For example, it is well-knownthat cats are afraid of loud noises and that dogs are startled by highfrequency noises.

Application selection could be controlled to prevent distractions to adriver. For example, video games may be blocked from being played if nopassenger is detected. However, audio input and output could beselectively enabled. Applications that could be subject to vehiclesystem control may include navigational aids, e-mail systems,entertainment devices, mobile communication devices, news devices, andselected transactions requiring attention (e.g., banking and securitiestrading).

The applications may be controlled according to their complexity. Thiswould allow the passenger to engage in activities that may require aconcentration level that would be dangerous for the driver. For example,when a passenger is detected in the seat next to the driver, a visualdisplay may be enabled for use by a passenger. Such “complexity” ofapplications may be determined in advance. Only large abstract iconswould be shown to the driver alone instead of detailed text.Programmable buttons would be made large. In this way the display issimplified and usable by the driver at a glance or a touch of thedisplay screen. If a passenger is detected, then the interaction may bemade more detailed.

Additionally, the function of application requests made by a lone drivermay be selectively tailored by the system so that the output isappropriately constructed to their attention level. For example,summarized information may be returned, length of responses could beshortened, and/or visual representations enlarged.

For example, FIG. 4 illustrates a simplified video display and audio fora driver without a passenger. In the example of FIG. 4, the videodisplay is simplified, but the audio display is more detailed. Incontrast, FIG. 5 illustrates a video display and audio for a vehiclewith a passenger sensed. In FIG. 5, the video display is more complex,but the audio is simplified. Manual control may be used to adjustgradations of video and audio richness.

Additionally, some indicia indicating the age or maturity of a passengercould be sensed and used to enable or disable functions. For example,the weight (and/or height) of a driver or passenger could be detectedand used to enable or disable functions.

For example, adult entertainment could be disabled when children (e.g.,generally and relatively light-weight people) are identified as beingpresent. Alternatively, a height of the passenger could be gauged andthose having less than a predetermined height (and thus deemed to bechildren who are generally and relatively shorter than adults) would bebarred from such adult entertainment.

Thus, with the unique and un-obvious structure of the present invention,a passenger may be detected and based on such detection, the informationsystem user interface may be selectively controlled appropriately. Thus,adaptive user interfaces may be provided based on such detection of apassenger to make vehicle operation safer. Further, when a non-drivingpassenger is using a device (e.g., providing information orentertainment), the device function may be selectively made more complexand more detailed for the passenger.

Thus, with the invention, a vehicle's information system user interfacemay be selectively changed depending upon whether passengers aredetected in the vehicle, thereby to increase utility for the passengerdetected, and in the absence of a detected passenger, increase vehicledriving safety.

While the invention has been described in terms of several preferredembodiments, those skilled in the art will recognize that the inventioncan be practiced with modification within the spirit and scope of theappended claims.

What is claimed is:
 1. A system for controlling a vehicle informationsystem user interface comprising: at least one sensor for sensing apresence of a non-driving passenger in a vehicle; and a controller forcontrolling the vehicle information system user interface to selectivelyprovide an appropriate level of interaction therewith for a driver,based upon an output signal from said at least one sensor.
 2. The systemaccording to claim 1, wherein a plurality of ones of said at least onesensor are provided at predetermined positions in said vehicle.
 3. Thesystem according to claim 1, wherein said controller comprises anelectronic control unit (ECU) for processing said output signal fromsaid at least one sensor.
 4. The system according to claim 3, whereinsaid controller further comprises a vehicle communication bus forcarrying data to said electronic control unit.
 5. The system accordingto claim 4, wherein said controller further comprises a plurality ofelectronic control circuits connected to said vehicle communication bus.6. The system according to claim 5, wherein said plurality of electroniccontrol circuits connected to said vehicle communication bus areselectively interfaced with a plurality of devices.
 7. The systemaccording to claim 1, wherein said controller comprises means forcontrolling adjustable control parameters.
 8. The system according toclaim 1, wherein said at least one sensor for sensing the presence of apassenger senses a weight of an occupant in a vehicle seat for anon-driving passenger.
 9. The system according to claim 1, wherein saidat least one sensor senses a weight of a passenger and outputs a valuerepresenting said weight to said controller.
 10. The system according toclaim 1, further comprising: a car bus electrically connected to saidsensor, wherein said bus comprises one of a Society of AutomotiveEngineers (SAE) J1850 bus and a Controller Area Network bus.
 11. Thesystem according to claim 6, further comprising: a car bus electricallyconnected to said sensor, wherein said bus comprises one of a Society ofAutomotive Engineers (SAE) J1850 bus and a Controller Area Network bus.12. The system according to claim 6, wherein said plurality of devicescomprise at least one of a visual display device, an audio system, akeyboard, a telecommunications device, a fax machine, a touch screen, aspeech synthesis system, a voice recognition interface, a wirelessremote control device, a scent dispenser, a heating device, and acooling device.
 13. A system for detection of a vehicle occupant andcontrol of a user interface comprising: at least one sensor for sensinga presence of a vehicle occupant; and a controller for selecting one ofa plurality of modes of use for a vehicle system user interface toselectively provide an appropriate level of interaction therewith for adriver, based on a composition of said vehicle occupant.
 14. The systemaccording to claim 13, wherein a plurality of ones of said at least onesensor are provided at predetermined positions in said vehicle.
 15. Thesystem according to claim 13, wherein said plurality of modes comprises:a mode for a vehicle with a driver and no passengers.
 16. The systemaccording to claim 13, wherein said plurality of modes of use comprises:a plurality of modes of use for application to a vehicle with a driverand a plurality of non-driving passengers having a plurality ofcharacteristics.
 17. The system according to claim 13, wherein saidplurality of modes comprises: a plurality of modes of audio presentationcomprising at least one of enriched speech, simplified speech, reducedsound intensity, frequency-filtered sound, audio balance shifted todriver, and audio balance shifted to passenger.
 18. The system accordingto claim 13, wherein said plurality of modes comprises: a plurality ofmodes of video presentation comprising at least one of enriched video,simplified video, video display disabled, and video display enabled. 19.The system according to claim 13, wherein said plurality of modescomprises: a plurality of modes of mechanical presentation comprising atleast one of video display directed to driver, and video displaydirected to passenger.
 20. The system according to claim 13, whereinsaid controller comprises means for controlling adjustable controlparameters.
 21. The system according to claim 20, wherein saidparameters are programmable by a user.
 22. The system according to claim13, wherein said plurality of modes of use for a vehicle are selectedmanually by a user.
 23. The system according to claim 16, wherein saidplurality of characteristics includes said non-driving passenger havinga predetermined measure of weight.
 24. The system according to claim 23,wherein a second characteristic of said plurality of characteristicsincludes said non-driving passenger having a weight less than saidpredetermined measure of weight.
 25. A system for detection of a vehicleoccupant and control of a user interface comprising: at least one sensorfor sensing a presence of a vehicle occupant; and a controller forselecting one of a plurality of modes of use for a vehicle system userinterface based on a composition of the group of vehicle occupants,wherein said plurality of modes comprises a plurality of modes for avehicle with a driver and a plurality of non-driving passengers having aplurality of characteristics, and wherein said plurality ofcharacteristics includes a heartbeat of a non-driving passenger having apredetermined heartbeat rate.
 26. A system for detection of a vehicleoccupant and control of a user interface comprising: at least one sensorfor sensing a presence of a vehicle occupant; and a controller forselecting one of a plurality of modes of use for a vehicle system userinterface based on a composition of the group of vehicle occupants,wherein said plurality of modes comprises a plurality of modes for avehicle with a driver and a plurality of non-driving passengers having aplurality of characteristics, and wherein said plurality ofcharacteristics includes a heartbeat pattern of a non-driving passengerhaving a predetermined shape.
 27. The system according to claim 13,wherein said sensor comprises a manually-controlled sensor.
 28. Thesystem according to claim 13, wherein said sensor comprises auser-programmable sensor.
 29. A system for controlling a vehicleinformation system user interface comprising: at least one sensor forsensing a presence of a non-human passenger, said non-human passengerbeing an animal; a controller for controlling a vehicle informationsystem user interface based upon an output signal from said sensor; anda scent dispenser coupled to said at least one sensor, wherein when saidnon-human presence is sensed, said scent dispenser is activated.
 30. Asystem, for controlling a vehicle information system user interfacecomprising: at least one sensor for sensing a presence of a non-humanpassenger; and a controller for controlling a vehicle information systemuser interface based upon an output signal from said sensor, whereinsaid presence of a non-human passenger is sensed by at least one ofsensing a predetermined heartbeat rate and a predetermined heartbeatshape.
 31. A system for controlling a vehicle information system userinterface comprising: at least one manually-controlled sensor, manuallycontrollable by said user, for sensing a presence of a non-humanpassenger, said non-human passenger being an animal; a controller forcontrolling a vehicle information system user interface based upon anoutput signal from said at least one manually-controlled sensor; and ascent dispenser coupled to said at least one sensor, wherein when saidnon-human presence is sensed, said scent dispenser is activated.
 32. Thesystem, as claimed in claim 13, wherein said plurality of modes arecoupled such that a change in a value of a first mode is offset by achange in a value of a second mode such that a total value of saidcoupled modes remains substantially the same.
 33. The system of claim13, wherein two or more modes of said plurality of modes are adjustedsimultaneously and qualitatively to supplement each other.
 34. Thesystem of claim 1, wherein said system is for use with at least one ofdiagnostics, e-mail, news, weather, traffic, concierge, emergency help,and entertainment.
 35. The system of claim 13, wherein said system isfor use with at least one of diagnostics, e-mail, news, weather,traffic, concierge, emergency help, and entertainment.
 36. The system ofclaim 1, wherein said controller controls the vehicle information systemuser interface in an operable mode to selectively provide an active,attenuated level of interaction therewith for the driver.
 37. The systemof claim 13, wherein said controller controls the vehicle informationsystem user interface in an operable mode to selectively provide anactive, attenuated level of interaction therewith for the driver.